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Description 

Dialogue Learning System Based On Template -Template 
Structure 

Technical Field 

The present invention relates to a new dialogue 
learning system having a template- template structure based on 
extraction rules and exploiting the expanding power of buggy 
rules . 

Background Art 

The invention is motivated by a keen need for 
automating and simplifying the time-consuming authoring task 
used for language -oriented intelligent learning systems. 
This is because even though the number of possible correct 
right responses is reasonably limited, it is often necessary 
to deal with a large, in fact, theoretically unlimited number 
of plausible errors of learners for developing cin ideal 
learning system. As far as the inventors can judge, at least 
within the foreseeable future, the state of the art in 
natural leuiguage processing technology cannot reach the level 
capable of providing a ready solution to an automatic 
correction of an entirely free format error-ridden sentence. 
This seems possible only when the world knowledge base of so- 
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called common sense may be introduced into the system so that 
many competent human teachers can somehow manage to cope with 
it. 

Disclosure of the Invention 

A lecLming system according to the invention 
{ "Azalea" ) , to which the concept of template automaton is 
introduced, collects many "expected examples of a variety of 
learners, including "right" and "wrong" responses. As an 
efficient error diagnosis engine in the language learning 
system, the NLP technology of cui HCS (heaviest common 
sequence) or an LCS (longest common sequence) algorithm plays 
a decisive role. Those examples embedded into the template 
is used for the diagnosis and analysis of learners' responses. 
The diagnosis is to be implemented by selecting a closest 
path from among a huge number of candidate paths in template 
databases to the learner's input sentences. The authoring 
task of building a template corpus consisting of well- formed 
model translations and ill-formed erroneous sentences is 
quite labor-intensive, taking up considerable time. 

The new system of the invention not only simplifies or 
reduces the authoring task of template generation, which 
otherwise is time-consuming (refer to, JP-A No. 2002-49617 by 
Naoyuki Tokuda, Lisuig Chen, Hiroyuki Sasai, et al) , but also 
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is effective for the improvement of system perf ormcuice. The 
first reason why the introduced template -template 
curchitecture can simplify the system and improve the 
performance is that the architecture mcikes it possible to 
integrate many different templates into a single template- 
template and vice versa, that is to extract many different 
templates therefrom by applying extracting rules assigned to 
some of transition nodes of a single template. The second 
reason is that the introduced buggy rules have the function 
of automatically distinguishing and classifying erroneous 
learners' responses and, accordingly, generating bugs 
therefrom « The importance of the NLP (natural leuiguage 
processing) techniques in the development of the system is 
obvious because a parser is used for examining the learner's 
structure free-format response and the semantic structure is 
examined by checking the learner's response in character 
string against the semantically equivalent path of the 
provided template data base. 

The template -template structure based on the new 
extracting rules or buggy rules is expected to play an 
important role in mauiy applications, when used in any system 
selected from learning systems having character input and 
interaction means, voice-based call centers or voice -enabling 
portal systems, and any systems focusing on more enhanced 
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human computer Interfaces Implementing more natural human- 
computer Interactions between the system and humcins. 

The present Invention provides the following three 
contributions : 

1 . Embedding extracting rules Into certain nodes of the 

template -template transitional diagram with certain 
constraints Imposed In selecting the nodes enables a single 
template -template to represent a variety of different types 
of existing templates. 

2* Exploiting the expanding power of the buggy rules 

Introduced, many erroneous expressions and/or many erroneous 
syntactic structures can now be described automatically with 
consistency so that the new template -template can be expanded 
to a "thick" template- template form, because of Its automatic 
capability of describing the bug taxonomy. The icuiguage 
teacher need not be concerned with details of classifying 
erroneous translations at the time of authoring the template - 
template, thus bearing a reduced burden of error taxonomy, 
when evaluating and clustering the cheuract eristics of the 
particular errors of learners. 

3. The HCS matching algorithm can be developed so that 
the algorithm matches the Input sentence against the simpler 
template -template directly, thus reducing the spatial and 
temporal calculation load In matching processes In finding 
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the best matched paths from among all the possible path of 
all the extracted templates without actually expanding the 
template- template . 

Best Mode for Practicing the Invention 
Template -Template Structure 

First the term "template-template" will be defined 
below. The template -template is defined as a special template 
where some of the nodes are marked with extracting rule- 
associated symbols allowing the template -template to be 
expanded into many templates, or a so-called large template 
if a set of non- connected templates are regarded as one 
template. Such a set of disconnected templates can now allow 
a variety of possible translations of a single LI sentence to 
form a large single template -template comprising a group of 
translated L2 sentences. Being an extended template, the 
template- template scheme allows the template -template to 
extract one or more of the templates. 

Typically, an extracting rule is always associated 
with a set of symbols, say {s^, S2, s^}, and each of the 
symbols is assigned one or more nodes in the templates. These 
associated symbols are assigned with one or more values whose 
function is to represent the style of the nodes that will 
appear in a template or templates extracted from the 
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template -template. These symbols are herein referred to as 

label symbols." The symbols related to a single rule cure 
called "related symbols." Related symbols should have certain 
restrictions. As a typical restriction, for a given s^=l, Sj^ 
must often be restricted to 2, or to some positive integers 
other than 1 . If the value of depends on the values 
assigned to a set of the other symbols, the choice of value 
of is called a required choice of the other symbols. 

Some excimples of the extracting rules are given below 
so that Icuiguage teachers can easily understand. 

Type A Rule AP (appear) - NAP (not appear) Rule 

Suppose that some nodes are marked with API, while 
some other nodes are marked with NAPl (1 being any integer, 
representing different Type A Rules). The AP-NAP Rule of Type 
A Rule imposes the condition that when expanded, a new 
expanded template can include either the nodes marked with 
API or the nodes marked with NAP^, but not both of them at 
the same time. "AP^sO" is used to denote the case where the 
nodes marked with AP^ do not appear in a template. At this 
time, NAP^ have to be i, meaning that the nodes marked with 
NAP^ will appeeir in the template. Thus, it can be seen that 
NAP^-1 is the required choice of AP^-0, By the same reasoning, 
when NAP^^O, AP^ must have a value of I, so that NAP^-0 is the 
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required choice of AP^-l • 

Type B Rule PPR (personal pronoun) - PPRP (personal pronoun 
possessive) Rule 

As in the Type A Rule, the template -template rule 
imposes the condition that the nodes marked with PPRl and the 
other nodes marked with PPRPl (1 being any integer) appearing 
in a set of templates must respectively take on the form of 
the personal pronoun and the personal pronoun possessive form 
of the pronouns as required by the natural latnguage grammar 
of the pronouns • Given PPRP^ ( or PPRj^ ) , the required values of 
PPRj^ (or PPRPj^ ) must be defined by the natural language 
grammar of pronouns. 

Type C Rule AN (arbitrary number) Rule. 

Type C Rule imposes the condition that any positive 
real number can be assigned to the nodes marked by AN^^ . If it 
is true that " I have 5 books on Zen , " this Rule AN^ can be 
assigned to the error node of 5, because any number other 
than 5 is erroneous. 

Type D Rule CHO (choosing -one) rules. 

A type D Rule imposes the condition that among all the 
nodes of the template -template marked by CHOl^, CHO±2, 
CHOlj,^^ one and only one set of nodes can appeeu: in any of the 
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templates extracted from the template- template. Here a 
different 1 represents a different Type D Rule. Hence, 
CHOij=0 Implies that the nodes marked by CHOl^ do not appear, 
while CH01j=l Implies that the specified nodes now appear. 
Obviously, If 1 Is assigned to one CHOlj,, then 0 should be 
assigned to all the other CHOlj . 

The Buggy Rules for Expanding Template -Template 

A buggy rule here Is defined as a production rule of 
common syntactically erroneous expressions which are 
characterized by possible deviations from syntactically 
correct expressions. 

To be specific, consider the following form of a buggy rule: 

where H^H^^Mff represents a set of nodes tracking the 
syntactically correct path of any template - templates , or a 
set of grammatical part -of -speech tags representing basic 
components or segments of a correct expression. R^Rz^^m is 
set of nodes which represents a typical erroneous expression 
whose correct form is HJi^^Hj^ . It is immediately seen that 
errors are identified by deviations from the correct paths of 
the template -template. Here is an example: 

EX VBP-^ EX VBZ 
(Here EX represents existential such as "there is," VBP, 
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verb for cuid 2*^ person present, VBZ, verb, 3rd person 
singular present). This example Implies that a syntactically 
correct expression "there are 5 books" Is used erroneously by 
students who misunderstood the subject-verb alignment, 
resulting in an erroneous expression of "there Is 5 books" in 
this example. 

Brief Description of the Drawings 

Figure 1 is a diagram showing a template -template 
structure . 

Figure 2 is a diagram showing a template -template 
structure expanded by expansion rules. 

Figure 3 is a diagram showing a template 1 expemded 
for a sentence meaning "Japan is dotted with beautiful 
gardens nationwide" . 

Figure 4 is a diagram showing a template expeuided for 
a sentence meaning "Japan is dotted with beautiful gardens 
nationwide" . 

Description of Symbols 
Error Messages: 

AS: an assumption has been made on the quantity of the noun 

AT: the eurticle is not needed 

CM: a comma is needed 

CT: contraction is incorrect 
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MN: meaning is incorrect 

NP: noun must be plural 

VS: verb must be singuleur, since subject is singular 

PR: preposition is incorrect 

PP: phrase must be plural 



Typical Part -of -Speech Tags: 

DT : Determiner 

IN : Preposition/Subord . 

conjunction 

NN: Noun, singular or mass 
NNP: Proper noun, singular 
VBN: Verb, past particle 

VBZ: Verb, 3rd ps. sing. 
Present 



EX: Existential 
JJ: Adjective 

NNS : Noun , plural 
RB : Adverb 

VBP: Verb, non-3rd ps. sing. 
Present 



The invention will be described in the following 
embodiment with reference to drawings. 

Figure 1 is a diagram showing a template -template 
structure; Figure 2 is a diagram showing a template -template 
structure expanded by the expansion rules; Figure 3 is a 
diagram showing a template 1; and Figure 4 is a diagram 
showing a template 2. 

Example of Template-Template, Template -Template Expanded by 
Buggy Rules, and Templates Extracted from Template-Template 
In the embodiment of the invention, a template- 
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template for English translations of a Japanese sentence 
meaning Japan Is dotted with beautiful gardens nationwide." 
Is constructed at first. The numeral shown In Figure 1 and 
other figures represent the weights of word for enhancing the 
relative Importance of the respective words In the sentence. 
The default weights of the words In the template are set to 
I , and they must be assigned In accordance with the 
Importance of the words as judged by experts In the field. 
Reference Is made to JP-ANo. 2002-49617 by Naoyukl Tokuda, 
Liang Chen and Hlroyukl Sasal, for a detailed explanation. 
The symbols within and are the part -of -speech tags. 

The nodes shown In the left edge are starting nodes. 

Now simply applying the buggy rules listed above can 
expand It Into the template -template of Figure 2. 

This shows that a language teacher need not be 
concerned with the details of classifying many common errors 
when he/she Is constructing the template- template, since the 
buggy rules can generate teixonomlzatlon of bugs, 
automatically allowing these erroneous expressions to be 
built Into the template -template. 

Now, by applying the Type A rule. It Is easy to see 
that It Is possible to extract a template as shown In Figure 
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3 from the template- template of Figure 2 by allowing the 
nodes marked with AP^ to appear in the template and 
accordingly by deleting the nodes m£u:ked by NAPj of Figure 2, 
as well as the template as shown in Figure 4, this time by 
deleting the nodes meurked by AP^ of Figure 2, and accordingly 
letting the nodes marked with NAP^ appear in the template. 

It can be seen that a language teacher is able to 
construct the template -template, integrating a leirge 
combination of templates in terms of simpler label symbols. 

Matching Algorithm for Template -Template and the heaviest 
common sequence for an input sentence 

As is evident from the above discussion, many 
templates can be extracted from a single template- template. 
Suppose a template -template has label symbols s^^s^, ^, s„ to 
be associated with certain nodes of the transitional diagram; 
it is seen that the different templates extracted from the 
template -template can be obtained by assigning these symbols 
to nodes. In the invention, it is possible to denote each 
template extracted from the template by an tuple 
iSi,Pi,S2,P2 — # s„,p„}, where p^'s are proper assignment to 
symbols s^. As has been discussed in an earlier section, p^'s 
can be either numbers or words in accordance with the 
extracting rules used. 
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A heaviest common sequence of two sentences Is defined 
as an ordered sequence of words, a^^a^^^^a^ which appear in 
both of the sentences in an order of a^ then a2 then ... then 
cL„ . The definition of common sequence can be found in the 
book "Foundations of Computer Science" by A. V. Aho and J- D. 
Ullman (Computer Science Press, 1992, pp. 321-327) 

As each word or phrase in the template is assigned 
with weights, the heaviest common sequence of a path in the 
template and an input sentence is defined as the common 
sequence among all the possible common sequences whose total 
weights are the largest. 

A heaviest common sequence in words and/ or phrases of 
an input sentence is searched for from among all the possible 
valid paths of the template. 

The heaviest common sequence of a template and an 
input sentence is defined as the heaviest common sequence of 
words which has the heaviest total weight among the heaviest 
common sequences, each of which is obtained from one path of 
the template and the input sentence. 

Once the template- template has been obtained in cin 
application involving a language translation leeuming system. 
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the next step is to match an input sentence to each of all 
the possible templates, and then choose the closest path. A 
detailed description on the DP (dynamic programming) -based 
matching procedure of a template to a sentence can be found 
in JP-A No. 2002-49617 by Naoyuki Tokuda, Liang Chen and 
Hiroyuki Sasai. 

In the method of the present invention, a closest path 
is found from among all the valid paths of the templates that 
could be extracted from template-template with extracting 
rules (but without buggy rules) directly, without physically 
extracting all the templates from the template -template. It 
is necessary to expand the buggy rules -embedded template- 
template first so that the template -template does not include 
any buggy rules before such a matching teikes place. This can 
be performed in the steps of Figure 2 described above. 

The first step needed in the algorithm is to convert a 
template -template into its dual figure of £ui acyclic weighted 
finite digraph (directed graph), by simply expressing each 
node of the template as one or several arcs in the graph, by 
adding arcs labeled with 0 weight for each empty node where 
applicable. Since the digraph is converted from the template- 
template, it contains many arcs associated with label symbols 
whose functions depend critically on the values assigned to 
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the symbols. Accordingly given one such digraph, a completely 
different template can be extracted if a different set of 
label symbols are assigned to arcs. That is to say, given 
such a digraph, it is possible to obtain many digraphs, each 
of which corresponds to a template that can be extracted from 
the template -template. The digraph extracted from template- 
template is hereinafter called a template -digraph. 

The inventors now define a procedure of finding the 
heaviest common sequences from among the common sequences of 
the paths of all the digraphs and an input sentence as below. 

The heaviest common sequence of the paths ended by any 
special node N in a digraph and an input sentence is defined 
as the sequence of words which has the heaviest total weight 
among all the heaviest common sequences, each of which is 
obtained from one path ended by N of the digraph and the 
input sentence. 

Furthermore, let N^{Sj,Pi,S2,P2^*^^s„,p„} represent the 
paths of all the digraphs extracted from a template -digraph 
but ending at node N^, where the symbol is assigned with 
value (1^1,2, ^,n) . An n-tuple {Si,p^,S2,P2,^*,s„,p„} is 
referred to as a label of node N^. Here it should be assumed 
that there is no contradiction of the rules when is set as 
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p^, S2 as P2,^, s„ as p« . Such a label {s^,p^,S2,P2.-^, s^.pj is 
reffered to as a contradiction -free label. 

The heaviest common sequence of a node labeled 
^i{Si,Pi,S2,P2^**»^s„,p„} and an input sentence is defined as the 
heaviest common sequence of words which has the heaviest 
total weight among all the heaviest common sequences, each of 
which is obtained as the heaviest common sequence of one 
digraph extracted from the digraph- template with the nodes 
marked with the contradiction- free label fs^j^pj^s^^p^,-.., s„,p„J . 

Note that some nodes can not appear simultaneously in 
one digraph extracted from a digraph- template, as in a node 
labeled AP2 and a node labeled NAP2 in one digraph. As the 
result, the rule breaking label such as N^C..., AP2,1, 
NAP2,1...) should not be allowed in any calculation scheme of 
the common sequences of a node in the digraph- template and an 
input sentence. The following algorithm describes the 
procedure for calculating the heaviest common sequence of a 
template -template and an input sentence. In the following . 
calculation, "X" is used as a very special value of the label 
symbols, whereby its value remains unspecified up to a 
certain stage of the calculation. 

1. Turn the template- template into a ten^late- digraph of 
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which the directed edges (transitions) are labeled by the 
corresponding words in the template; 

2. Topologically sort all the nodes of the digraphs into 
Ni, N2, such that for each pair of nodes and Nj, 
there is no transition from to N^, when J>1; 

3. Add an empty node to the digraph, and add an arc 
from Nq to all the stcurting nodes in the template -template. 

4. Set CM(No,MJ=0 

5. For 1-0 to t, do the following steps: 

6. If there is at least one arc to which is associated 
with a symbol, and the s related labels would never exist 
after the node N^, then for all i's, for J=0 to m, do the 
following: 

caieck all CM(N^{^} ,Mj) , for any label {s^,p^,S2,P2'***^s^,p„} , if 
no s -related label appears in {s^,s,2, -.^s„J and there exist 
at least an {s^,Pi,S2,P2.^,s„,Pn, sx^^px^, 3X2, px2, sx^,pxj,}, 
where sx^, sxj, .-.,sxi, are s related labels, such that 
CM(Nl{s^,Pi,S2.P2^^^s^,p^, sx^,px^, sx2,px2, sx^,px^}, Mj) is 
defined. Define CM(Ni{Si,Px,S2,P2#-#Sn,p„}, M^) as the largest 
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CM{li±{s^,Pj,S2,P2,^.s^,p^, sx^,px^, sx^^px^, ^, sx^.px^y, M^), and 
un-define all the Ctfl(U±{s^,Pi,S2,P2.*^.3^,p^, sx^,px^, sx^^px^, 
sx^,pxj,}, Mj) that had already been defined. 

7. For J=0 to m, do the following steps: 

8. For each of the nodes N,^ to which there is ein arc from 
N^, do the following: 

(1) If arc N^Nj, has no label. Check all the CM(N^{^}, 
Mj), CM(NJ^))))), Mj,J, CM(N^{^.}, M^) ^ CM(NJ^) , M^.J that 
have been defined, define CM(Nj^{Sj,Pi,S2,P2,^,s„,p„}, M^^^) as 
the maximum of the following data if one of 

CM(Nl{s^,p^,S2,P2.^.S^,pJ, Mj), CM(N±{Si,p^,S2,P2,^,S^,pJ, M^^J, 
CM(N}z{s^,p^,S2,P2.^.S^,pJ, Mj), CM(Nk{Sj,Pi,S2,P2,'^.s^,pJ, M^^J 
has already been defined: 

CM(Ni{Si,Pi,S2,P2#.-/S„,p„}, Mj) if it has already been defined 
M(N^{s,,p,,S2.P2,^,s^.pJ, Mj)-^W(N,NJ if 

CM(Nj^{s^,Pj,S2,P2^^,,s^,p^} , Mj) had already been defined and the 
arc NjNj^ is matched with Wj^ 

CM(Nl{Si,p^,S2,P2,^rS„,p„}, Mj^i) if it has already been defined 
CM(NK{s^,Pj^,S2,P2**^,s^,p^} , Mj) , if it has already been defined 
CM(Nk{Si,Pi,S2,P2^*-^s„,Pn}, Mj^^) if it has already been defined 

(2) If arc NjNj, is associated with symbol s, check all 
the CM(NJ^), Mj), CM(NJ^}^ Mj, J , CM(NJ^) , M^) , CM(N^{^} , M^.J 
that have been defined. 
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(i) If the node label (s^,p^,S2,P2^*--^ s^^p^^s, k} is a 
contradict Ion- free label, and at least one of the following 
has already been defined: 

affNi{"Si,Pj,S2,P2.-.s„.P„i. M^), CM(N^{ s^,p^,S2,P2.^,s^,p^ }, Mj^^), 
CM(Nj,{s^,p^,S2,P2.^^S^,pJ, Mj), CM(Nj,{ S^,p^,S2.P2.'^,S„,p^ }. M^^J, 
CM(N^{s^,p^,S2,P2,^.s„,p„,s, k}, Mj), CM(NJs^,p^,S2,P2.^^.s„,p„,s, 

CM(Nj,{s^,p^,S2,P2^^^s^,p^,s, k}, Mj), CM(Nj,{s^,p^,S2,P2,^.s„,p„, 
a;, M^,J ; 

Define CM(Nj^{s3^,P3^,S2,P2^*^fS^,p^,s, k}, M^^^) as the maximum one 
of the above defined data. 

(11) Given label {s^,p^,S2,P2^'-'MS„,Pn} . suppose that the label 
{Si,p^,S2,P2^**»^s^,p^,s,p} Is a contradict Ion -free label, and 
that at least one of the following Is true: 

CM(Ni{s2,Pi,S2,P2^--'^ Sn,p^} , Mj) has been defined and, if setting 
s to p is a required choice of {Sj,Pi,S2,P2*---fS„,Pg^} or NjNj^ is 
matched to M^^^ after p is assigned to s. 
CM(Ni{Sj,Pi, S2,P2****f s„,p„} , Wj^jj, has been defined and if 
setting s to p is a required choice of {s^,p^,S2,P2*»^^s^,p^} 
CM(Nk{Si,Pi,S2,P2**^^s„,Pa}, Mj) , has been defined and if setting 
s to p is a required choice of {Si,p^,S2,P2M»^^ s^,Pa} 
CM(N3c{Si,Pi,S2,P2.'**.s^,p„,s,p}, Mj^^), has been defined 
CM(Ni{Si,Pi,S2,P2.^^s„,p„,s,p}, Mj), has been defined 
CM(Ni{s^,p^,S2,P2.*^^s^,p^, ,s,p}, Mj^J, has been defined 
CM(Nk{s^,Pj,S2,P2^^^s^,p^, ,s,p}, Mj), has been defined 
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CM(NkiiSi,p^,S2,P2^*^^s^,p^, ,s,p}, Mj^J has been defined 
Define CM(N^{Sj^,pj^,S2wP2^-**^s^,p^,s,p} , Mj^^) as the maximum one 
from the above defined data and the following data 
CM(Nl{s,,p^,S2,P2.^.s„,pJ, Mj)'^W(Mj^J if 

CM(N±{s^,Pi,S2,P2*-**'S^,p^} , Mj) Is defined and N^Nj^ Is matched to 
Mj^j after p Is set to s. 

CM(Ni{s^,p^,S2,P2,*^^s„,p^,S,p}, Mj)-^W(Mj^j,) If 
CM(Nl{s^^p^,S2,P2^***^s^,Pa,s,p}, Mj) Is defined and NjNj^ Is 
matched to M^^^ after p is assigned to s 

And also change those s^ from X to a required choice of the 
value, subject to the condition of p being assigned as s. 

Among all the CM(N,, 1%^) already defined with being 
a final vertex, the largest CM{N,,, M^) will be the weight of 
the heaviest common sequence of the template -template and the 
path. 

Note that. In the above algorithm, whenever CM(N. ( . . ) , 
M. ) Is selected from several candidates a kind of back link 
Is set to the selected one . Note that by tracing the back 
link It Is possible to obtain the path of the extracted 
template which has the heaviest common sequence with the 
Input sentence Immediately, as having found the weight of the 
largest common sequence of the template -template and the path. 
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Industrial Applicability 

Although the invention has been described for the 
technical field of a natural language learning system, the 
application of the invention is not limited to natural 
language learning systems, and rather the invention is 
applicable to any of voice -enabling technology, a 
programming language leearning system; cuid systems which need 
more natural advanced interfaces allowing human- computer 
interactions . 
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